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Rank  Tests  in  Weather  Modification  Experiments 

by 

t4organ  A.  Hanson* 

1.  Introduction.  Rank  tests  are  frequently  used  in  the  comparison  of 
seeded  and  unseeded  responses  or  of  control  and  target  responses  in  weather 
modification  experiments.  The  difficulty  in  characterizing  rainfall  distri- 
bution makes  such  nonparametric  tests  desi  One  of  the  more  frequently 

used  tests  is  the  sum  of  squared  ranks  test  Ov  ised  by  Taha  [6]  and  further 
investigated  by  Mielke  [3,4]  and  Duran  and  Mielke  [2].  It  has  been  shown  by 
these- autliors,  under  certain  questionable  assumptions,  that  this  test  has  a 
higher  asymptotic  efficiency  relative  to  the  more  conventional  Wilcoxon  test, 
that  is,  the  sum  of  (first  power)  ranks  test. 

The  effect  of  taking  the  squares  of  the  ranks  of  the  observations 
rather  than  the  first  powers  is  to  attach  much  greater  weight  to  the  larger 
observations,  and  when  there  are  hundreds  of  observations,  as  is  not  unusual 
in  weather  modification  experiments,  this  means  that  the  smaller  observations 
are  essentially  ignored,  llftiy  this  should  be  desirable  is  not  intuitively 
clear. 

It  is  the  purpose  of  this  paper  to  investigate  the  pertinence  to  reality 
of  the  underlying  assumptions  in  the  analysis  of  weather  modification  exper- 
iments by  rank  methods;  and  it  will  be  shown  under  certain  assumptions  that 
for  the  usual  objectives  in  weather  modification  and  for  the  usual  ranges  of 
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parameter  values  involved  in  such  experiments,  the  sum  of  squared  rank  tests 
is  not  uniformly  more  efficient  asymptotically  than  the  Wilcoxon  test. 

All  of  the  data  used  in  this  paper  have  been  obtained  from  the  Santa 
Barbara  Convection  Band  Study.  It  is  possible  that  some  of  the  conclusions 
are  not  applicable  to  other  areas,  or  other  types  of  storms.  We  can  only 
suggest  that  for  each  experiment  in  which  rank  tests  are  used  the  underlying 
assumptions  be  checked  for  validity  from  the  data,  as  should  be  done  in  any 
case  of  course. 

2.  Assumptions.  The  fundamental  assumption  used  in  the  theory  given  in 
justification  of  the  use  of  the  sum  of  squared  ranks  test  in  weather  modifi- 
cation experiments  is  that  the  effect  of  cloud  seeding  is  to  produce  a 
change  in  the  scale  of  the  rainfall  distribution.  The  origin  of  this  assump- 
tion has  been  attributed  [2]  to  the  single  unsubstantiated  statement  by  Scott 
and  Neyman  [5] : 

"...the  opinion  of  certain  knowledgable  meteorologists  may 
be  quoted  that,  if  the  seeding  of  clouds  has  an  effect  on 
precipitation  in  the  target,  this  effect  is  multiplicative. 

In  other  words,  if  for  a given  X=x  the  expected  nonseeded 
precipitation  in  inches  is  n(x)  than  the  expected  precipi- 
tation affected  by  seeding  will  be  ri(x)e2^,  where  C stands 
for  the  positive  or  negative  conventional  measure  of  the 
effect  of  seeding." 

Two  questions  r>rise  here:  firstly,  is  there  evidence  to  support  this  belief, 

nnd  secondly,  if  the  belief  is  vnlid,  what  rclcvince  does  it  have  to  the  pur- 
pose of  cloud  seeding? 

As  far  as  data  from  the  Santa  Barbara  Study  indicates,  t’'.ere  does  not 
appear  to  be  any  narticular  reason  to  single  out  scale  change  as  the  only 
systematic  distributional  effect  of  cloud  seeding.  Each  point  in  Figures  1 
and  2 represents  a randomly  chosen  rain  gauge  in  Phase  I of  the  Santa  Barbara 


3 


Figure  1 : 

The  scale  parameter  65  of  the  gamma  distribution  fitted  to  the  observed 
distribution  of  rainfall  over  all  seeded  bands  at  twenty-one  randomly  chosen 
locations  in  Phase  I of  the  Santa  Barbara  Study  plotted  against  the  scale 
parameter  ^ for  unseeded  bands  at  the  same  locations. 


The  shape  parameter  of  the  gamma  distribution  fitted  to  the  observed 
distribution  of  rainfall  over  all  seeded  bands  at  twenty-one  randomly  chosen 
locations  in  Plaase  I of  the  Santa  Barbara  Study  plotted  against  the  shap^ 
parameter  for  unseeded  bands  at  the  same  locations. 


i ; 


y. 


Study.  The  ordinates  6^^  and  Bg  are  the  respective  scale  parameters,  and  the 


ordinates  and  o^are  the  respective  shape  parameters  of  gamma  probability 

.0-1 


distribution  functions  (f(x)  = 


1 


r(o)8" 


) fitted  to  the  unseeded  and  seeded 


rainfall  distributions, over  all  observed  storms,  at  each  experimental  location. 

We  see  that  the  observed  effect  on  the  scale  parameter  is  far  less  systematic 
and  far  more  variable  than  it  is  on  the  shape  parameter. 

However,  with  regard  to  the  second  question  raised  above,  the  appropriate 
matter  to  consider  is  not  the  effect  per  se  on  either  of  these  parameters.  If 
we  were  interested  in  changes  of  scale,  then  perhaps  it  would  not  be  unreasonable 
to  use  a test  which  sises  the  larger  observations,  where  the  absolute 

effect  of  scale  c ^^reatest.  A more  usual  matter  of  interest,  though, 

would  be  the  effect  of  seeding  on  average  precipitation.  (Note  that  the  mean  of 
the  gamma  distribution  is  o3;  so  these  two  parameters  are  equally  important  as  far 
as  the  mean  is  concerned.)  Hence,  if  we  desire  to  have  a test  based  on  a single 
parameter,  it  would  be  more  appropriate  to  reparameterize  the  distribution,  using 
the  mean,  say,  as  one  of  the  parameters,  and  base  our  theory  of  test  efficiency 
on  the  relevant  parameter.  So  we  write 


f(x) 


1 


where  y is  the  mean  of  the  gamma  distribution,  and  6 is  retained  as  a free  (nuisance) 
parameter  since  the  effect  of  seeding  on  ' B is  relatively  much  more  variable  than 
it  is  on  a. 

3 . Asymptotic  Relative  Efficiency.  Let  Xj , . . . , and  Yj , . . . , 
be  independent  random  samples  from  two  populations  with  cumulative  distri- 
butions F(x)  and  G(x)  respectively.  The  two-sample  sum  of  r-th  power  rank 
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test  statistic  A is  defined  by 
Nr 

1 ^ ■ 

A.,  = id"  y Z„. 

Nr  i-1  ^ 

where  N = m + n,  and  = 1 or  0 if  the  i-th  smallest  value  in  the  combined 
sample  of  X's  and  Y's  is  an  X or  a Y respectively. 

We  consider  testing  the  null  hypothesis 


G(x)  = F(x) 

against  an  alternative  of  the  form 

G(x),=  F(4.(x,9)) 


for  some  specified  cumulative  distribution  function  F which  has  a density  f 
defined  on  [0,«);  and  for  some  specified  function  (p  whose  range  is  [0,«>)  and 


which  depends  on  a parameter  0 such  that  41  (x,  0^)  = x,  and  that 


i'®l0=0 


o 

exists  and  is  integrable  on  [0,®).  It  is  further  assumed  that  the  conditions 
of  the  Chernoff-Savage  [1]  asymptotic  normality  theorem  for  nonparametric 
test  statistics  hold. 

2 

Let  lig  ^^Nr^  denote  the  mean  and  variance  of  Aj^  under  0.  Then 

the  efficacy  of  the  test  statistic  Aj^^^  is  defined  by 


eCAjgr)  =. 


j0  . 

~NA  0 ^ 

N 


V°0 


where  A.,  « ^ . 

N N 


The  asymptotic  relative  efficiency  of  the  test  statistic  with  respect  to 


the  statistic  A.,  is  defined  by 

e(A  A 1 . ■ 

Application  of  the  asymptotic  normality  theorem  for  nonparametric  test 
statistics  given  by  Chernoff  and  Savage  [1]  gives 

00 

L F(4,(x,0))]’'dF(x) 


and 


»e  ^ 'V> 

o (r  + 1)  (2r  + 1)  NX 


N 


where  the  sign  "v  indicates  that  the  ratio  of  the  two  sides  tends  to  unity 
as  N tends  to  infinity. 

Hence,  we  obtain 


ae 


0=0 


r(i  - x^)  f2  dx 

) 0=0 


So  the  efficacy  of  Aj^^  for  large  samples  is 


e(A  ) ^ (r  + l)^(2r  * 1)  / f^  dx 

J-  0 -L'’  -'0  = 0 

O 


Li 


Hence,  for  example,  the  asymptotic  relative  efficiency  of  the  sum  of  squared 
ranks  test  with  respect  to  the  Wilcoxon  test  is  given  by 

2 


_ 15 

e('v^  , 'A^  ) - 4 


fH-l  F dx 


/o  = 


0C 


f"  |3± 
lo  [ae 


f^  dx 


0=0 
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These  results  do  not  assume  any  specific  rainfall  distribution. 


4.  Efficacy  for  the  Gamma  Distribution.  If  it  is  supposed  that  the  unseeded 
and  seeded  rainfall  distributions  are  gamma  distributions  with  parameters 
and  (u,6)  respectively,  then  the  seeded  rainfall  y can  be  related  to  the 
unseeded  rainfall  x by  the  equation: 


ni  ) B 


-^-1  -- 
1 S B 

ft  e dt , 

r0  6^ 


In  order  to  evaluate  the  expression  for  the  efficacy  obtained  at  the  end  of 


Section  3,  we  now  seek  an  expression  for  the  term 


, that  is,  in  terms 


of  the  notation  used  above. 


with  respect  to  a,  we  obtain: 


Differentiating  the  above  equation 


u=Po- 


(r(|)  b“)' 


U 


ii-1  -I  ii-.l  .1  , 

e ^ + Jo  t®  In  t e ®dt|  = 0. 


r(|)  B® 


iZ  = L f 

^11  II.  tr  ' 


1 ^ V ^ 

~1  -- 


-Z 

By®  e ^ 


+ In  B - In  t dt  . 


n 


Hence  finally. 


1 t®  ^ e’®  I ^ ^ 

Wo  , X ^ I 


li=Uo  ^-1  -p 

B X®  e ^ 


♦ In  e - In  t dt 


w„ 


Thus  for  the  gamma  distribution  we  have  the  efficacy  of  for  large  samples 


- 1)^  (2r  ^ 1)  „ X 

^0  Tr.l  ■ / 

6(r(^)  6^  f ^ ° 


.X  ^-1  -|  r-  0 

X-  / t‘"  e e_  + In  B-  - In  t dt 

o . V ••  J 


I r-^  -r 

[ /^  t*^  e^  dtj  )dx 


5.  Conclusion.  The  asymptotic  efficiency  ©(A^,  A^)  of  the  squared  rank 

test  relative  to  the  Wilcoxon  test  for  the  range  of  values  of  occurring  in 

6 

Phase  I of  the  Santa  Barbara  Study  are  given  in  Figure  3.  We  see  that  under 

the  assumptions  involved  in  the  above  theory,  the  squared  rank  test  is  more 

Uo 

efficient  for  values  of  less  than  0.72,  but  for  greater  values  the  Wilcoxon 
test  is  more  efficient. 


P ^ 


Figure  3; 

The  asymptotic  efficiency  [eCA^,  A^)]  of  the  squared  rank  test  relative  to 
1 Mo 

the  Wilcoxon  test  as  a function  of  — , where  Vq  is  the  mean  and  B is  the  scale 
parameter  of  the  unseeded  rainfall. 
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